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Field of tte Tnvention 



,t trie invenuuii 

This invention generally relates to a method and system tha, can monitor and 

using at leas, one Dynamic Linked Library (DLL) shared between the plural targe, 

30 applications. 
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Discussion " f thp Rflckground 

With the rise of compute, usage, software development has clearly become a 
significant business. In evaluating software, i, may be beneficial to monitor exactly how a 
user utihzes a software application. As an exampie, it may be helpful for a software 
developer to know which commands a user uses most often and how long those commands 
tak e to execute. Such an analysis is often referred to as "profiling.- (Analogous analysts was 
performed on instructions in instruction sets to develop reduced instruction se, computing 

(RISC) instructions.) . 

Further, in designing device, with which a human interacts, it may be durable to 
monitor how the user interacts with such a device. As an example, i, may be desirable to 
monitor how a user utilizes a control panel of an image forming device such 
facsimile machine, printer, scanner, an appliance such as a microwave oven, VCR, dtgrtal 
camera, cellular phone, palm top computer, etc. 

Further, users are increasingly utilizing the internet. There is significant mteres, « 
How users use the Internet, particularly with respect to how users may use certain web pages. 
Monitoring a user's usage of the Interne, may a.so become sigmficant. 

„ may also be desirable to determine how a user is utilizing a certam apphcaUon urn, 
( e g , a computer running a software application, a device with an interface to be operated by 
. user, or a web page). The user's usage of the application unit must be momtored and 
effectively communicated to a remote party. 

gt TMMARY O c ™ INVENTION 
One object of the present invention is to provide a novel and effective system for 
monitoring a useA usage of an interface of a target application of an 

A further object of the present invention is to provide a novel system for 
commumcating data obtained by monitoring a user's usage of an interface of a target 
applicationofanapplicationunittoaremoteparty. 

A further object of the present invention is to efficiently communicate the momtored 
usage information to a transmission unit. 

The present invention achieves these and other objects by monitonng the usage of 
user interface of a targe, application of an application unit. Monitoring examples include (1) 



monitoring a software program being executed on a computer or workstation under control of 
a user, (2) monitoring usage of a control panel of an image forming apparatus (e.g., a copying 
machine, printer, facsimile, or scanner), an appliance (e.g., a microwave oven, VCR, digital 
camera, cellular phone, or palm top computer), and (3) monitoring any other device or system 
5 that has a user interface. The data obtained by monitoring a user's usage of a target 
application of an application unit can, as a further feature in the present invention, be 
collected, logged and communicated to a desired location by Internet e-mail. The use of e- 
mail communication reduces the costs associated with communicating such data. The data 
can be communicated to the desired location at several instances. Such instances include 
10 each time a user exits a target application of an application unit, or after a predetermined 
number of times that a user has utilized and exited the target application of the application 
unit. If the configuration allows and if necessary, the direct connection between the 
monitored application and the monitoring system can be established in addition to the e-mail 
in communication. 
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B RIEF DESCRIPTION OF THE DRAWINGS 
jjO A more complete appreciation of the present invention and many of the attendant 

^ advantages thereof will be readily obtained as the same becomes better understood by 

j 6 * reference to the following detailed description when considered in connection with the 

!=£0 accompanying drawings, wherein: 

h Figxjj^Tillu^ates three networked business office machines connected to a network 

M of computers and databases through the Internet; 

Figur^^iUustrates the components of a digital image forming apparatus; 
Figure^illustrates the electronic components of the digital image forming apparatus 
25 illustrated in Figure2f~ 

Figure^Hllustrates details of the multi-port communication interface illustrated in 
Figure 3; ^ 

Figure SJJlustrates an alternative system configuration in which business office 
devices are either connected directly to the network or connected to a computer which is 
30 connected to the network; 
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Figure JjAnllustraies in block diagram format the flow of information to and from an 
application unit using electronic mail; 

Firrii«*a /CD ;i1,,rt+».r. + «o n 1 , r ^£ + ~ ~ . 1 „ : 1 1 I — 
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which the computer which is connected to the application unit also serves as a message 
5 transfer agent; 

Figure 6'C illustrates an alternative way of communicating using electronic mail in 
which an application unit includes a message transfer agent for exchanging electronic mail; 

Figure^ illustrates an alternative manner of sending messages across the Internet; 

/ 

Figure 8 ^illustrates an exemplary computer which may be connected to the device and 
10 used to communicate electronic mail messages; 

Figure 9^sHows in block diagram format connections between a monitoring and 
logging subsystem, a communications subsystem and a target application of an application 
unit in the present invention; 
x q Figure 1 (^shows a first example of an application unit to which the present invention 

135 can be applied; 

w Figure 11 shows a second example of an application unit to which the present 

ijQ invention can be applied; 



Figure 12^sho ws the general architecture of the system; 

L f 

" Figures 13. /shows an overall view of objects executed in the present invention; 

|«E0 Figure 14, shows information in an abstract class transferred between a monitoring 

|j3 package and a sendmg^packag^in the present invention; 

'"^ Figures 1 5A and 1 5B show multiple target applications interacting with a dynamic 

link library (DLL) to communicate with a monitoring package (implemented as either a 
seperate process or within the DLL itself); 
25 Figure l^shows a setApplicationID operation executed in the present invention; 

Figures 1 T^shows a startMonitoring operation executed in the present invention; 
Figures 1 8^shows a commandUse operation executed in the present invention; 

Figure 19*shows a stopMonitoring operation executed in the present invention; 

/ 

Figure 20 shows the operation of packaging the usage data of the target application 
30 and passing it to the sending package in the present invention; 
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Figure 24 shows the operation of sending the usage data of the target application in 
the sending package in the present invention; 



structure of Figure 22 in the present invention; 

Figure 24^hows a second map stxuctiire which can be utilized to store data in the 
present invention; and 



Figure 2^shows specific examples of data which can be stored in the second map 
structure of Figure 24 in the present invention. 



Referring now to the drawings, wherein like reference numerals designate identical or 
corresponding parts throughout the several views, Figure 1 illustrates (1) various machines 
and (2) computers for monitoring, diagnosing and controlling the operation of the machines. 
In Figure 1, there is a first network 16, such as a Local Area Network (LAN) connected to 
computer workstations 17, 18, 20 and 22. The workstations can be any type of computers 
including IBM Personal Computer compatible devices, Unix-based computers, or Apple 
Macintoshes. Also connected to the network 16 are (1) a digital image forming apparatus 24, 
(2) a facsimile machine 28, and (3) a printer 32. As would be appreciated by one of ordinary 
skill in the art, two or more of the components of the digital image forming apparatus 24 and 
the facsimile machine 28 can be combined into a unified "image forming apparatus." The 
devices 24, 28 and 32 and the workstations 17, 18, 20 and 22 are referred to as machines or 
monitored devices and other types of devices may be used as the machines or monitored 
devices, including any of the devices discussed below. Also, a facsimile server (not 
illustrated) may be connected to the network 16 and have a telephone, ISDN (Integrated 
Services Digital Network), cable or wireless connection. In addition to the digital image 
forming apparatus 24, facsimile machine 28, and printer 32 being connected to the network 
16, these devices may also include conventional telephone and/or ISDN and/or cable and/or 
wireless connections 26, 30 and 34, respectively. As is explained below, the business office 
machines or business devices 24, 28 and 32 communicate with a remote monitoring, 




invention; 



Figure 23^£liows specific examples of data which can be stored in the first map 




DESCRIPTION OF THE PREFERRED EMBODIMENTS 



>to^^i, also referred to as a monitoring devic^^rc 



diagnosis and control stanon, also referred to as a monitoring device^nrough the Internet via 
the network 16 or by a direct telephone, ISDN, wireless, or cable connection. 

In Figure 1, a wide area network (WAN) (e.g., the Internet or its successor) is 
generally designated by 10. The WAN 10 can either be a private WAN or a public WAN. 
5 The WAN 10 includes a plurality of interconnected computers and routers designated by 
12A-12I. The manner of communicating over a WAN is known through RFC documents 
obtained by HTTP://www.ietf.org/rfc.html. TCP/IP related communication is described for 
example in the book "TCP/IP Illustrated," Vol. 1, The Protocols, by Stevens, from Addison- 
Wesley Publishing Company, 1994, which is incorporated herein by reference. Volumes 1-3 
10 of "Internetworking with TCP/IP" by Comer and Stevens are also incorporated herein by 
reference in their entirety. 

In Figure 1, a firewall 14 is connected between the WAN 10 and the network 16. A 
firewall is a device that allows only authorized computers on one side of the firewall to 
^ access a network or other computers on the other side of the firewall. Firewalls are known 

135 and commercially available devices and/or software and, for example, include SunScreen 
C3 from Sun Microsystems Inc. Similarly, a firewall 50 is connected between the WAN 10 and 

:jQ a network 52. Also, a firewall 40 is connected between the WAN 10 and a workstation 42. 

" The network 52 is a conventional network and includes a plurality of workstations 56, 

IS 

!** 62, 68 and 74. These workstations may be in different departments (e.g., marketing, 

i^O manufacturing, design engineering and customer service departments) within a single 
^ company. In addition to the workstations connected via the network 52, there is a 

ijy workstation 42 which is not directly connected to the network 52. Information in a database 

stored in a disk 46 may be shared using proper encryption and protocols over the WAN 10 to 
the workstations connected directly to the network 52. Also, the workstation 42 includes a 
25 direct connection to a telephone line and/or ISDN and/or cable and/or wireless network 44 
and the database in disk 46 may be accessed through the telephone line, ISDN, cable or 
wirelessly. The cable used by this invention may be implemented using a cable which 
typically is used to carry television programming, a cable which provides for high speed 
communication of digital data typically used with computers or the like, or any other desired 
30 type of cable. 
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Information of th^business office machines 24, 28 and 32 may be stored in one or 
more of the databases stored in the disks 46, 54, 58, 64, 70 and 76. Known databases include 
(1) SQL databases by Microsoft. Ot-aHp. *nH Sybase (2) other relational databases, and (3) 
non-relational databases (including object oriented databases). Each of the customer service, 
marketing, manufacturing, and engineering departments may have their own database or may 
share one or more databases. Each of the disks used to store databases is a non-volatile 
memory such as a hard disk or optical disk. Alternatively, the databases may be stored in any 
storage device including solid state and/or semiconductor memory devices. As an example, 
disk 64 contains the marketing database, disk 58 contains the manufacturing database, disk 
70 contains the engineering database and disk 76 contains the customer service database. 
Alternatively, the disks 54 and 46 store one or more of the databases. 

In addition to the workstations 56, 62, 68, 74 and 42 being connected to the WAN, 
these workstations may also include a connection to a telephone line, ISDN, cable, or 
wireless network which provides a secure connection to the machine being monitored, 
diagnosed and/or controlled and is used during communication. Additionally, if one 
communication medium is not operating properly, one of the others can be automatically 
used for communication. 

A feature of the present invention is the use of a "store-and-forward" mode of 
communication (e.g., Internet e-mail) or transmission between a machine and a computer for 
diagnosing and controlling the machine. Alternatively, the e-mail which is transmitted may 
be implemented using a mode of communication that makes direct, end-to-end connections. 

Figure 2 illustrates the mechanical layout of the digital image forming apparatus 24 
illustrated in Figure 1. In Figure 2, 101 is a fan for the scanner, 102 is a polygonal mirror 
used with a laser printer, and 103 designates an F lens used to collimate light from a laser 
(not illustrated). Reference numeral 104 designates a sensor for detecting light from the 
scanner. 105 is a lens for focusing light from the scanner onto the sensor 104, and 106 is a 
quenching lamp used to erase images on the photoconductive drum 132. There is a charging 
corona unit 107 and a developing roller 108. Reference numeral 109 designates a lamp used 
to illustrate a document to be scanned and 110, 111 and 112 designate mirrors used to reflect 
light onto the sensor 104. There is a drum mirror 113 used to reflect light to the 
photoconductive drum 132 originating from the polygon mirror 102. Reference numeral 114 
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designates a fan used to cool the charging area of the digital image forming apparatus, and 

1 1 5 is a first paper feed roller used for feeding paper from the first paper cassette 117, and 

1 16 is a manual feed table. Similarly, 1 1 8 is a second paper feed roller for the second 
cassette 119. Reference numeral 120 designates a relay roller, 121 is a registration roller. 122 

5 is an image density sensor and 123 is a transfer/separation corona unit. Reference numeral 
124 is a cleaning unit, 125 is a vacuum fan, 126 illustrates a transport belt, 127 is a pressure 
roller, and 128 is an exit roller. Reference numeral 129 is a hot roller used to fix toner onto 
the paper, 130 is an exhaust fan and 13 1 is the main motor used to drive the digital copier. 

Figure 3 illustrates a block diagram of the electronic components illustrated in Figure 
10 2. The CPU 160 is a microprocessor and acts as the system controller. Random access 
memory (RAM) 1 62 stores dynamically changing information including operating 
parameters of the digital c opier. A non-volatile memory (e.g., a read only memory (ROM) 
164) stores the program code used to run the digital copier and also information describing 
jjg the copier (static-state data) such as the model number, serial number of the copier, and 

|3 5 default parameters . 

Q There is a multi-port communication interface 166 which allows the digital copier to 

(l n communicate with external devices. Reference number 168 represents a telephone, ISDN, or 

™ cable line and 1 70 represents a network. Further information of the multi-port 

j"* communication interface is described with respect to Figure 4. An interface controller 172 is 

j*=20 used to connect an operation panel 174 to a system bus 186. The operation panel 174 

includes standard input and output devices found on a digital copier including a copy button, 
keys to control the operation of the copier such as number of copies, 

reducement/enlargement, darkness/lightness, etc. Additionally, a liquid crystal display may 
be included within the operation panel 1 74 to display parameters and messages of the digital 

25 copier to a user. 

A storage interface 176 connects storage devices to the system bus 186. The storage 
devices include a flash memory 178 which can be substituted by a conventional EEPROM 
and a disk 1 82. The disk 1 82 includes a hard disk, optical disk, and/or a floppy disk drive. 
There is a connection 180 connected to the storage interface 176 which allows for additional 

30 memory devices to be connected to the digital copier. The flash memory 178 is used to store 
semi-static state data which describes parameters of the digital copier which infrequently 
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change over the life of tnecopier. Such parameters include the options and configuration of 
ihc digital copier. An op+inn interface 184 allows additional hardware such as an external 
interface to be connected to the digital copier. A clock/timer 187 is utilized to keep track of 
both the time and date and also to measure elapsed time. 

On the left side of Figure 3, the various sections making up the digital copier are 
illustrated. Reference numeral 202 designates a sorter and contains sensors and actuators 
used to sort the output of the digital copier. There is a duplexer 200 which allows a duplex 
operation to be performed by the digital copier and includes conventional sensors and 
actuators. The digital copier includes a large capacity tray unit 198 which allows paper trays 
holding a large number of sheets to be used with the digital copier. The large capacity tray 
unit 198 includes conventional sensors and actuators. 

A paper feed controller 196 is used to control the operation of feeding paper into and 
through the digital copier. A scanner 194 is used to scan images into the digital copier and 
includes conventional scanning elements such as a light, mirror, etc. Additionally, scanner 
sensors are used such as a home position sensor to determine that the scanner is in the home 
position, and a lamp thermistor is used to ensure proper operation of the scanning lamp. 
There is a printer/imager 192 which prints the output of the digital copier and includes a 
conventional laser printing mechanism, a toner sensor, and an image density sensor. The 
fuser 190 is used to fuse the toner onto the page using a high temperature roller and includes 
an exit sensor, a thermistor to assure that the fuser 190 is not overheating, and an oil sensor. 
Additionally, there is an optional unit interface 188 used to connect to optional elements of 
the digital copier such as an automatic document feeder, a different type of sorter/collator, or 
other elements which can be added to the digital copier. 

Figure 4 illustrates details of the multi-port communication interface 166. The digital 
copier may communicate to external devices through a Centronics interface 220 which 
receives or transmits information to be printed, a cable modem unit 22 1 which has a high 
speed connection over cable, a SCSI interface 222, a conventional telephone interface 224 
which connects to a telephone line 168 A, an ISDN interface 226 which connects to an ISDN 
line 168B, an RS-232 interface 228, and a LAN interface 230 which connects to a LAN 170. 
Other interfaces (not shown) include, but are not limited to, Firewire and Digital Subscriber 
Line (DSL) (original DSL, concentric DSL, and asymmetric DSL). Fire Wire (IEEE 1394) is 
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snT, "The Facts About "Fire Wire", IEEE Spectrui 



described in Wickelgren^T, "The Facts About "Fire Wire", IEEE Spectrum, April 1997, Vol. 
34, Number 4. pp. 19-25, the contents of which are incorporated herein by reference. 
Preferably, communication utilizes a "reliable" protocol with error detection and 
retransmission. Examples of such a protocol include Reliable Datagram Protocol (RDP) and 
5 Transmission Control Protocol (TCP). A single device which connects to both a Local Area 
Network and a telephone line is commercially available from Megahertz and is known as the 
Ethernet-Modem. 

The CPU or other microprocessor or circuitry executes a monitoring process to 
monitor the state of each of the sensors of the digital copier, and a sequencing process is used 
1 0 to execute the instructions of the code used to control and operate the digital copier. 
Additionally, there is a central system control process executed to control the overall 
operation of the digital copier and a communication process used to assure reliable 
communication to external devices connected to the digital copier. The system control 
% process monitors and controls data storage in a static state memory such as the ROM 1 64 of 

ft 5 Figure 3, a semi-static memory such as the flash memory 178 or disk 182, or the dynamic 
□ state data which is stored in a volatile or non- volatile memory such as the RAM 162 or the 

flash memory 178 or disk 182. Additionally, the static state data may be stored in a device 
other than the ROM 1 64 such as a non- volatile memory including either of the flash memory 
■* 178 or disk 182. 

J20 The above details have been described with respect to a digital copier but the present 

zl invention is equally applicable to other business office machines or devices such as an analog 

O copier, a facsimile machine, a scanner, a printer, a facsimile server, or other business office 

machines, or appliances with which a user interface (e.g., a microwave oven, VCR, digital 
camera, cellular phone, palm top computer). Additionally, the present invention includes 
25 other types of devices which operate using store-and-forward or direction connection-based 
communication. Such devices include metering systems (including gas, water, or electricity 
metering systems), vending machines, or any other mechanical device (e.g., automobiles) that 
need to be monitored during operation or remote diagnosis. In addition to monitoring special 
purpose machines and computers, the invention can be used to monitor, control, and diagnose 
30 a general purpose computer which would be the monitored and/or controlled device. . 
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Figure 5 illustrates an alternative system diagram of Ate invenuon in which dtfferen, 
_ .„_,ems are connected to the WAN 10. However, there is no retirement to 
raveTach of thes'e devices or subsystems as part of the invention. Each component or 

UtaLd in Figure , may be connected to the WAN 10 which is iilustrated ,n F.gure 5. In 

254 connected to the intranet 25 2 indudes therein or has connected thereto data 256 wh.ch 
may be stored in a database forma,. The data 256 includes history, performance, 
maLction, and any other information including statistical information of the op^ahon or 
failure or set-up and components or optional equipment of devices which are bemg 
;Ired.ThI service machine254 may be implemented asthedevice or computer w h ch 

diagnostic tests be performed on the monitored devices. The serv.ce machtne 25 may be 
implemented as any type of device and is preferably implemented using a compu.er.zed 
device such as a general purpose computer. 

Another sub-system of Figure 5 includes a firewall 258, an rntrane, 260, and a pnnter 
262 connected thereto. !n this sub-system, the Actions of sending and receiving electron. 

microprocessor, or any other type of hardware contained with.n or mounted to the pnnter 
(i.e., without using a separate general purpose computer). 

An aitemate type of sub-system .nciudes the use of an rnterne, serv.ee 
which may be any type of .nteme. service provider (ISP), including known commere.al 
iZanie such as America Online, Netcom, CompuServe, Niftyserve, the Fernet se^ce 

modem for example, such as a telephone line modem, a cable modem, modems whtch use^ 
ZZ of — h as modems used over an ,SDN grated Services Digital Network) 
Une ASDL (Asymmetric. Digital Subscriber Line), modems which use frame relay 

modem, a fiber optic modem, or a device which uses infrared l.gh, waves. Fu*e, a 
business office device 268 is connected to the computer 266. As an alternate to the 
«officedevice26S(and any other device illustrated in Figure 5), a different type of 
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machine may be monitored or controlled such as a digital copier, anytype of appliance, 
security system, or utility meter such as an electrical, water, or gas utility meter, or any other 
device discussed herein. 

Also illustrated in Figure 5 is a firewall 270 connected to a network 274. The 
network 274 may be implemented as any type of computer network, (e.g., an Ethernet or 
token-ring network). Networking software which may be used to control the network 
includes any desired networking software including software commercially available from 
Novell or Microsoft. The network 274 may be implemented as an Intranet, if desired. A 
computer 272 connected to the network 274 may be used to obtain information from a 
business office device 278 and generate reports such as reports showing problems which 
occurred in various machines connected to the network and a monthly usage report of the 
devices connected to the network 274. In this embodiment, a computer 276 is connected 
between the business office device 278 and the network 274. This computer receives e-mail 
communications from the network and forwards the appropriate commands or data, or any 
other information, to the business office device 278. Communication between the business 
office device 278 and the computer 276 may be accomplished using wire-based or wireless 
methods including, but not limited to radio frequency connections, electrical connections and 
light connections (e.g., an infrared connection, or a fiber optics connection). Similarly, each 
of the various networks and intranets illustrated in Figure 5 may be established using any 
desired manner including through the establishment of wireless networks such as radio 
frequency networks. The wireless communication described herein may be established using 
spread spectrum techniques including techniques which use a spreading code and frequency 
hopping techniques such as the frequency hopping wireless technique which is disclosed in 
the Bluetooth Specification (available at the world wide web site www.bluetooth.com), which 
is incorporated herein by reference. 

Another sub-system illustrated in Figure 5 includes a firewall 280, an intranet 284, a 
computer 282 connected thereto, and a copier 286. The computer 282 may be used to 
generate reports and request diagnostic or control procedures. These diagnostic and control 
procedures may be performed with respect to the copier 286 or any of the other devices 
illustrated in or used with Figure 5. While Figure 5 illustrates a plurality of firewalls, the 
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firewalls are preferable Woptional equipment and therefore the invention may be operated 
without the use of firewalls, if desired. 

mm,™. £ A illustrate an annlication unit 300 connected to a typical e-mail exchange 

~ -o - - 

system which includes components 302, 304, 306, 308, 310, 312, 314, 316, and 318 which 
may be implemented in a conventional manner and are taken from Figure 28.1 of Stevens, 
above. A computer 302 interfaces with any of the application units 300 described herein. 
While Figure 6A illustrates that the application unit 300 is the sender, the sending and 
receiving functions may be reversed in Figure 6A. Furthermore, if desired, the user may not 
be needed to interface with the application unit 300 at all. The computer interface 302 then 
interacts with a mail agent 304. Popular mail agents for Unix include MH, Berkeley Mail, 
Elm, and Mush. Mail agents for the Windows family of operating systems include Microsoft 
Outlook and Microsoft Outlook Express. At the request of the computer interface 302, the 
mail agent 304 creates e-mail messages to be sent and, if desired, places these messages to be 
sent in a queue 306. The mail to be sent is forwarded to a Message Transfer Agent (MTA) 
308. A common MTA for Unix systems is Sendmail. Typically, the message transfer agents 
308 and 3 12 exchange communications using a TCP (Transfer Control Protocol) connection 
or a TCP/IP (Internet Protocol) connection. Notably, the communication between the 
message transfer agents 308 and 3 12 may occur over any size network (e.g., WAN or LAN). 
Further, the message transfer agents 308 and 312 may utilize any communication protocol. 
In the present invention, steps 302 and 304 reside in the library to monitor the application 
unit's usage. 

From the message transfer agents 312, e-mail messages are stored in user mailboxes 
314 which are transferred to the mail agent 3 16 and ultimately transmitted to the user at a 
terminal 3 1 8 which functions as a receiving terminal. 

This "store-and-forward" process avoids the sending mail agent 304 from having to 
wait until establishment of the direct connection with the mail. Because of network delays, 
the communication could take a substantial amount of time during which the application 
would be unresponsive. Such an unresponsiveness is generally unacceptable to users of the 
application unit. By using e-mail as the store-and-forward process, retransmission attempts 
after failures occur automatically for a fixed period of time (e.g., three days). In an alternate 
embodiment, the application controlling the user interface can avoid waiting by passing 
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communicating request^o^one or more separate threads. Those thrft can then control 
communication with the receiving terminal 318 while the application begins responding to 

• ... . .r- :„ t« ,,~+ „„^+u^r ^t-nVirtriim^nt in wViioh a user wishes to have 

QIC USCl UlLCliaw^ ctgcj-in. xaa jr^i. - 

communication completed before continuing, direct communication with the receiving 
terminal is used. Such directed communciation can utilize any protocol not blocked by a 
firewall between the sending and receiving terminals. Examples of such protocols include 
SMTP, HTTP, gopher, FTP, and NNTP. 

Public WANs, such as the Internet, is not considered to be secure. Therefore, 
messages transmitted over the public WANs (and multi-company private WANs) should be 
encrypted to keep the messages confidential. Encryption mechanisms are known and 
commercially available which may be used with the present invention. For example, a C 
library function, crypto, is available from Sun Microsystems for use with the Unix operating 
system. Other encryption and decryption software packages are known and commercially 
available and may also be used with this invention. One such package is PGP Virtual Private 
Network (VPN) available from Network Associates. Other VPN software is available from 
Microsoft Corporation. 

As an alternative to the general structure of Figure 6 A, a single computer may be used 
which functions as the computer interface 302, the mail agent 304, the mail queue 306 and 
the message transfer agent 308. As illustrated in Figure 6B, the application unit 300 is 
connected to a computer 301 which includes the message transfer agent 308. 

A further alternative structure is shown in Figure 6C in which the message transfer 
agent 308 is formed as part of the application unit 300. Further, the message transfer agent 
308 is connected to the message transfer agent 312 by a TCP connection 310. In the 
embodiment of Figure 6C, the application unit 300 is directly connected to the TCP 
connection 310 and has an e-mail capability. One use of the embodiment of Figure 6C 
includes using a facsimile machine with an e-mail capability (defined in RFC 2305 (a simple 
mode of facsimile using Internet mail)) as the application unit 300. 

Figure 7 illustrates an alternative implementation of transferring mail and is based on 
Figure 28.3 of Stevens. Figure 7 illustrates an electronic mail system having a relay system 
at each end. The arrangement of Figure 7 allows one system at an organization to act as a 
mail hub. In Figure 7, there are four MTAs connected between the two mail agents 304 and 



15 



# 



316. These MTAs incluoe local MTA 322, relay MTA 328, relay MTA 332, and local MTA 
340 The most common protocol used for mail messages is SMTP (Simple Mail Transfer 
Protocol) which may be used with this invention, although any desired mail protocol may be 
utilized. In Figure 7, 320 designates a sending host which includes the computer interface 
5 302, the mail agent 304, and the local MTA 322. The application unit 300 is connected to, or 
alternatively included within, the sending host 320. As another case, the application unit 300 
and host 320 can be in one machine where the host capability is built into the application unit 
300. Other local MTAs include local MTA 324 and 326. Mail to be transmitted and received 
may be queued in a queue of mail 330 of the relay MTA 328. The messages are transferred 
10 across the TCP connection 310, which may be, for example, the Internet, or may be any other 
type of network or connection. 

The transmitted messages are received by the relay MTA 332 and if desired, stored in 
a queue of mail 334. The mail is then forwarded to the local MTA 340 of a receiving host 
J* 342. The mail may be placed in one or more of the user mailboxes 314 and subsequently 

tl5 forwarded to the mail agent 316 and finally forwarded to the user at a terminal 318. If 
□ desired, the mail may be directly forwarded to the terminal without user interaction. Other 

|j local MTAs at the receiving side include MTA 338 and local MTA 336 which may have their 

^ own mailboxes, mail agents, and terminals. 

^ The various computers utilized by the present invention, including the computers 266 

^0 and 276 of Figure 5, may be implemented as illustrated in Figure 8. Further, any other 

computer utilized by this invention may be implemented in a similar manner to the computer 
^ illustrated in Figure 8, if desired, including the service machine 254, computer 272, and 

computer 282 of Figure 5. However, not every element illustrated in Figure 8 is required in 
each of those computers. In Figure 8, the computer 360 includes a CPU 362 which may be 
25 implemented as any type of processor including commercially available microprocessors 
from companies such as Intel, AMD, Motorola, Hitachi and NEC. There is a working 
memory such as a RAM 364, and a wireless interface 366 which communicates with a 
wireless device 368. The communication between the interface 366 and device 368 may use 
any wireless medium (e.g., radio waves or light waves). The radio waves may be 
30 implemented using a spread spectrum technique such as Code Division Multiple Access 
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(CD A) communication or using a frequency hopping technique such as that disclosed in the 
Bluetooth specification. 

There is a ROM 370 and a flash memory 371, although any other type of non- volatile 
memory may be utilized in addition to or in place of the flash memory 371 such as an 
EPROM, or an EEPROM, for example. An input controller 372 has connected thereto a 
keyboard 374 and a mouse 376. There is a serial interface 378 connected to a serial device 
380. Additionally, a parallel interface 382 is connected to a parallel device 384, a universal 
serial bus interface 386 is connected to a universal serial bus device 388, and also there is an 
IEEE 1394 device 400, commonly referred to as a fire wire device, connected to an IEEE 
1394 interface 398. The various elements of the computer 360 are connected by a system bus 
390. A disk controller 396 is connected to a floppy disk drive 394 and a hard disk drive 392. 
A communication controller 406 allows the computer 360 to communicate with other 
computers (e.g., by sending e-mail messages) over a telephone line 402 or a network 404. An 
I/O (Input/Output) controller 408 is connected to a printer 410 and a hard disk 412, for 
example using a SCSI (Small Computer System Interface) bus. There is also a display 
controller 416 connected to a CRT (Cathode Ray Tube) 414, although any other type of 
display may be used including a liquid crystal display, a light emitting diode display, a 
plasma display, etc. 

One feature in the present invention is to monitor how a user uses a target application 
of an application unit. The term application unit in this instance refers to a system which a 
user interacts with and controls. A "target application" refers to a user controlled system that 
controls the application unit. For example, an application unit may typically be a computer 
and a target application may then be a software program, e.g. a word processor, running on 
the computer which a user operates, for example by moving a pointer on a computer screen 
and "clicking" on certain command icons to cause the software program to perform certain 
functions. In this sense, an application unit in the present invention can refer to any of 
workstations 17, 18, 20, 22, 56, 62, 68, 74, 42 shown in Figure 1 running a software program, 
the computer 301 shown in Figure 6B running a software program, etc. An application unit 
can also refer to an image forming device such as any of the digital image forming apparatus 
24, facsimile machine 28, and printer 32 in Figures 1 and 2. In this instance, each of these 
device application units includes a user interface, such as operation panel 174 (see Fig. 3), 
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which a user interacts witn and utilizes to control the device application unit. The present 
invention can monitor a user selecting controls on such an operation paneL As a further 
example, the application unit could also be an appliance, such as a microwave oven, with an 
operation panel. An application unit can also refer to any other device, including software, 
with which a user interacts, and in this case the target application may refer to only one 
feature of the software which the user interacts with. 

One feature of the present invention is to monitor the user's usage of such a target 
application of an application unit, and to effectively communicate data of the monitored 
usage. This data will typically be transmitted by e-mail by the computer interface 302 of 
Figure 6A, or the computer of Figure 6B or the application unit 300 of Figure 6C. This data 
of a user's usage of a target application of an application unit can then be utilized in many 
ways, for example in improving software development, in monitoring usage of a device (e.g., 
an image forming device), discovering user difficulties with appliances and software, and 
finding most frequently used features of application units. 

Figure 9 shows various elements of the present invention. More particularly, Figure 9 
shows an application unit 300 including a target application 505 which includes a user 
interface 510. This user interface 5 1 0 is an interface for a user to control the application unit 
500 (via the target application 505). As discussed above, in one common instance, the target 
application 505 may be a software program running on one of the workstations 17, 18, 20, 22 
shown for example in Figure 1 of the present specification. In this instance, the user interface 
510 may be a display on a monitor of one of these workstations. One embodiment of such a 
target application is shown in further detail in Figure 1 0 which shows a monitor 600 of one of 
the workstations 17, 18, 20, and 22. In that embodiment of a target application, a plurality of 
function keys 605 are displayed on the monitor 600 and the user accesses those function keys 
by, for example, changing the positioning of a pointer with a mouse and "clicking" on one of 
such function keys. As a further example, if monitor 600 is a touch pad, the user controls the 
software application unit by touching one of the function keys 605. In those instances, the 
present invention monitors each time a user "clicks" on or touches one of the function keys 
605, and logs the usage data for subsequent communication. 

As a further example, and as noted above, the application unit 300 may be an image 
forming device such as the digital image forming apparatus 26, facsimile machine 28, or 
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# ,„ this instance, .he user interfacft) may take the form 
printer 32 also shown Jlfe- 1 • 1" *-» of keys ^ a 
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rented in ,he devflncluding the application unit in Figure oft can a,so be 
rented in the confer 30, in Fig. 6B ,o which ,he appHcation unr, ,s attached. Xte 
present invention can also take the form of computer control codes re— « , 



Pack a g e ,200andtheSendingPackage ,600. The Monitoring Package 
hrterfl actions, scoring, commandUse, stopMonrtoring, and set^ppl— , 
tire targe, appHcation 505 in order to monitor its usage. The Monitonng Package ,200 
responsible for monitoring and togging the usage of the targe, application 505 and men 

,600 The Monitoring Package ,200 incorporates the use of four components 
mterfaceManager , ,00, UsageLog 1 105, Data , 1 10, and Data Packaging/Send Interface 

,ha, a„o» tire target appHcation 505 to interface with the Monitoring ackage ,U£T* 
^erface^anager 1 ,00 also manages the usage da, of the targe, apphction 505 wrtta, *e 
Monitoring Package ,200. The UsageLog „05 ,ogs and maintains 
^e, appHcation 505. The UsageLog „05 contains a Command Vector „06 and T,me 

appHcation 505. The Data „ ,0 contains tire usage data of tire target appHcation 505. The 
d! Packaging/Send Interface „ , 5 packages the usage data of the target appHcation 05 
^d interfaces widr the Sending Package ,600 so that i, ma y pass tire packaged usage dataof 
the target appHcation 505 to the Sending Package 1600. 

As Iwn in Figure ,2, tire Sending Package ,600 provides the interface function 

sendUsageData to the Monitoring Package 1200 in order to send tire usage data of tire tar e. 

« "clon 505. The Sending Package 1600 is responsible for sending tire usage data of the 

four components, Interface/Manager 1 120, Data Type/Structure Converter 1 125. 
EnJdelcrvption 1130, andB-mai! Send 1,35. The Interfaced 1.20 provrdesthe 

16 „„ The Interface/Manager 1 .20 a,so manages the usage data of tire target appHcation 505 
lintheSendingPackage,600.TheDa,aT y pe/S tt ucti J reConver,er,,2 5 c h angesti,e 
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usage data of the targetlflication 505. As an example, if the usag^ta corresponds to the 
sequence of commands used in the target application 505, the Data Type/Structure Converter 
1 125 can change the usage data to correspond to the frequency uf use of the co-^snds of the 
target application 505. The Encoder/Encryption 1 130 encodes and encrypts the usage data of 
the target application 505 into a message body so that it may be sent by e-mail. The E-mail 
Send 1135 sends the usage data of the target application 505. Also shown in Figure 12 is the 
System object 1 375 that will allow the Monitoring Package 1200 and the Sending Package 
1600 to access and set system information. 

Figure 13 shows an overall system view of portions of the application unit 300. 
Figure 13 (as well as subsequent figures) describes the system and its operations in an object 
oriented format utilizing the unified modeling language such as is described in "The Unified 
Modeling Language User Guide" by Booch et al., published by Addison-Wesley, 1999. 

In Figure 13 the dashed-block contains objects responsible for the monitonng 
functions, and thus collectively indicates the Monitoring Package 1200. A CMonitorseqApp 
object 1300 provides the interface functions so that the target application 505 can use the 
monitoring functions. A CMonitoringlF object 1305 performs monitoring functions of the 
target application 505. A CUsageLogger object 1310 includes functions for logging 
monitored data obtained by the CMonitoringlF object 1305. A CClock object 1315 includes 
functions that allow the Monitoring Package 1200 to obtain time information. A 
CUserlDDialog object 1320 provides the dialog box for the user to enter in the user ID. The 
CUsageLogger object 1310 interacts with a System object 1375 to access and set system 
information. The CUsageLogger object 1310 also interacts with a CUsageData object 1325 
which is a storage for the logged data. 

As shown in Figure 13, the CMonitoringlF object 1305 interacts with a 
CUsageDataSendManager object 1330. The CUsageDataSend Manager object 1330 controls 
transmitting monitored data of a user' s usage of a target application 505 as monitored by the 
CMonitoringlF object 1305. This CUsageDataSendManager object 1330 interacts wtfh (1) a 
CAbsDataPackager object 1335 (which packages the usage data to be transmitted) and (2) a 
CAbsUsagelnformation object 1345 (which contains the usage data to be transmitted). The 
CAbsDataPackager object 1335 corresponds to an abstract class which provides the mterface 
functions to package the usage data of the target application 505. The class that is denved 
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*v,» n *»oe data of the target application 505. lne 

provides tne memou nn ^u 6 .. e - f 

CExiuWackager objec. .340 packages ft. usage da,afor a sing,e sess.cn of a«rge, 

application^. When the CUsageDa,aSendManager objeC 330 

CAbsT—ager objec, ,335 <o package the usage d- of a .arge, apphc «on 5^.« * 

, ■ ^Wnrnvidedbv the CExitDataPackager object 1340. lne 
actually using the packaging method provided by tne 

w t^^nackaees the usage data of the target application 505 into a 
CExitDataPackager object 1335 packages tne u g 

COneSessionUsagemformation object .350. The COneSessionUsagCnfonnanon o bj ec. 
1350 contains *e usage data for one session of the targe, app.ication 505. The 
CAbsUsage.nfonna.ion objec. .345 corresponds to an abstract Cass whtch provtdes th 

leabstiactclassCAbsUsage^^ 

w hich provides the method for accessing the usage da. of the target apphcation 505. Th 
CUsageDataSendManager objec. .330 a,so in.erac.s wi* <he Sending Package ,600 to send 
^I g eda tt ofu n e«ge.app.icauon505b y e- m ai.toadesiredpa rty . T*eSen*ng 
Lag .600 in.erac,s wift .he Conformation objec, .345. Whence Sendmg 
Package .600 in.erac,s«^^ 

fte .arge, application 505, U is «** *■ — * 

COneSessionUsage.nforma.ion objec, 1350. ^ 

Ftaure 14 shows an overall operatton executed m the system otug 

rAbsUsaeelnformation to the Sending Package 1600. TheCAbsusag 
CAbsUsagemiorm* TViic nneration instructs the Sending 

information from the monitored targe, apphcation 505. Tins °P«™ 
Package 1600.O send.be CAbsUsage.nforma,ion provided from *e Momtonng Pa^ge 
^00 The Sending Package 1 600 sends a confirmation signal YES ,o *e Momtonng 
Package ,200 ,o indicate «ha, i, was successft.1 in sending the usage da* of fte .arge, 

application 505. ^ . n , JA mi 

Tn an alternate embodiment ot the present mvcm 

target applications 505A and 505B. Those target apphca„ons 505 A and 505 
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multiple instances of the same application or copies of plural different applications. One 
such example of an application unit 300 with plural target applications is a single computer 
with plural touch screens controlled by different applications. Touch screen-b^J 
applications are now being utilized in department stores to provide customers with 
information (e.g., gifts registered as part of a bridal registry or a baby registry). 

It is unnecessary, however, to reproduce in each application the code that interacts 
with the monitoring block 515. Instead, as shown in Figure ISA. target application 505A and 
target application 505B can share code and data in the form of a dynamic linked hbrary . 
(Additional details about dynamic linked libraries (DLLs) can be found in Chapter 1 1 of 
Mastering Windows NT Programming, by Myers and Hamer, 1993, incorporated herem by 
reference.) As illustrated, the target application 505B invokes any of the functions exported 
by the DLL in the shared code region of the memory space. For example, as discussed m 
more detail below, the target applications can execute any of the following functions: 
setApplicationID, startMonitoring, commandUse, stopMonitoring. By utilizing a separate 
process to implement the monitoring block 515, the system of the present invention can 
operate independently to perform periodic tasks or tasks occurring at specific times or under 
specific conditions. One such independent operation is transmitting the monitored usage 
information to the receiver 3 1 8 at specified intervals (as is discussed in greater detail below n 

relation to trigger conditions). 

In the alternate embodiment illustrated in Figure 15B, the monitoring and logging 
block 515 is no longer implemented as a separate process. Instead, the monitoring and 
logging block is included in the shared code region of the dynamic linked library. As m the 
embodiment of Figure ISA, the target applications still invoke functions exported by the 
DLL to track the operations performed on the interface by using the setApplicationID, 
startMonitoring, commandUse, and stopMonitoring functions. 

The operations performed by the various objects noted in Figures 13 and 14 are now 
discussed in further detail in Figures 16-21. In Figures 16-21 the various functions are 
preceded by a numeral and a colon. It should be noted that this nomenclature is not always 
indicative of the order of the various operations as various operations can be performed in 



parallel and at different times. 
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Figure 16 showSetApplicationID function executed in the present invention. As 
shown in Figure 16, when the target application starts up, the target application 505 passes a 
char* as a parameter as it calls the setApplicationID function of the CMonitorseqApp object 
1300. The char* represents the identity of the application in which its usage is being 
monitored. In turn, the CMonitorseqApp object 1300 passes the same char* as a parameter as 
it calls the setApplicationID function of the CMonitoringlF object 1305. The CMonitoringlF 
object 1305 will inform the Monitoring Package 1200 to log the application ID. The 
CMonitoringlF object 1305 passes a string as a parameter as it calls the logApplicationID 
function of the CUsageLogger object 1310. The string represents the identity of the 
application in which its usage is being monitored. The CUsageLogger object 1310 passes the 
same string as a parameter as it calls the setApplicationID function of the System object 1375 
to set the application ID within the system. Then the CUsageLogger object 1310 passes two 
strings as parameters as it calls the addSessionData function of the CUsageData object 1325 
to store information about the application ID. One string represents the type of information 
passed in and the other string represents the value of the type of information. In this instance, 
the first string indicates that the type of information is the application ID and the second 
string is the value of the application ID. 

Figure 17 shows a startMonitoring function executed in the present invention. After 
the target application 505 executes the setApplicationID function as shown in Figure 16, the 
target application 505 calls the startMonitoring function of the CMonitorseqApp object 1300. 
In turn, the CMonitorseqApp object 1300 calls the startMonitoring function of the 
CMonitoringlF object 1305. This operation indicates that the logging of data corresponding 
to a user's usage of a user interface 510 of the target application 505 is to begin. The 
CMonitoringlF object 1305 then calls a logStartData function of the CUsageLogger object 
1310. 

The CUsageLogger object 1310 then calls a getUserlD function of the System object 
1375 and the System object 1375 returns a string to the CUsageLogger object 1310. The 
string returned by the System object 1375 represents the user ID. The CUsageLogger object 
1310 passes two strings as parameters as it calls the addSessionData function of the 
CUsageData object 1325 to store information about the user ID. In this instance, the first 
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microwave oven, VcAl camera, cellular phone, paim top computer, e,c. Again, 

„ , hnwtes in which *. monitoring can be stopped are: when the user mputs 

an exit command, after a predetermined time, after a predetermined „me of non-usage 
in Figure 19, when the user is exiting from the targe, application 505, the target 
application 505 calls the stopMonitoring function of the CMoni.orseo.App object 1300. In 
mm the CMoni.orseo.App object 1300 calls the stopMonitoring function of the 
CMonitoringlF object 1305. This operation indicates that the logging of data correspond 
toauser'susageofauserinterfaceSiOofthe.argetapplicationSOSis.osu.p. The 

CMonitoringlF object 1305 men calls a lo g S,opDa«a function of the CUsageLogger o bj ect 

' 310 ' The CUsageLogger object 13X0 men calls the ge.TimeElapsed function of CClocx 
object 1315 and the CCloCKObject 13.5 returns an in, to the CUsageLogger object 1310. In 
m operation the CClock object 1 3 1 5 returns an in, tha, represents me time elapsed smce*e 
start of the target application 505 to the time tha, tire user exits the targe, app 
represents ,he time elapsed in tenths of a second. The CUsageLogger ob,ect 1 0 passes a 
s l g and an in, as parameters as i, calls fhe addSess.onData function of the CUsageData 
object 1325 to store information about the duration of use of the targe, apphcation 505^ In 
this instance, the string indicates tha, the type of information is the duration of use of the 
target application 505 and me in, is the value of mis duration. 

After the CUsageLogger object 1310 logs the duration of the targe, apphcation 505, 
the CMo-moringlF object 1 305 calls the ge.UsageData fttnction of CUsageLogger object 

w » mn returns the CUsageData to the CMomtormglt 
1310andtheCUsageLoggerobjectl310retumsthei,usas 

object 1 305 The CUsageData contains data which includes all the stored momtormg data 
,he current session of the target application 505. The data includes the application ID, user 
ID, cumulative usage, star, time, duration and command usage. The CMonttormglF o^ c. 
,305 men passes the CUsageData as a parameter as i, cans the se„dUsageDa.aA.Tngger 
Action of me CUsageDataSendManager object 1330 to send the usage data of the target 



W 1 ^Oshowstheoperationofpac.agingtheusasedataofthetargetapplicat.on 

505 and passing i, to the Sending PacRage 1600 when the user exits the targe. 

505. This operation occurs when ,he targe, application 505 calls ,he stopMomtonng function 
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CUsageDataSendManager objec. .330, as of ,ep 7, in Figure tv co„> ~ . 
^dUsageDataA.Trigger function of .he CUsageDataSendManager object .330, as s.ep , 

in Figure 20. CUsa o e DataSendManager object 

After the sendUsageDataAtTngger function of the CUsageu 

, • .90 the CUsageDataSendManager object 1330 calls its own 

1 330iscalled 1 nF 1 gure20,theCUsageD C AbsDataPacka g er is an 

createDataPac^^^^ 
u- ♦ tw the CUsaeeDataSendManager object 1330 will use to pac g 

the target appi crea teDataPackager 

action, .. cans «he 8 CExit Da,aPackager objec, .340 packages 

create «he CExi.Da.aPaCcager object im * ^ rf ^ ^ 

the usage data of the target application 505 for the condin 

Hon 505 is to be sen, every time the user exits the targe, application 505. Then he 
apphcahon 50 be COneSessionU sa g eInforma«onfunc.io n of .he 

CExitDataPackager object 1340 c^l ■*> the co^essionUsagelnforrnation 

COneSessionUsagelnformation object 1350 to crea. ^ 
. • „, n50 ^ COneSessionUsagelnformation object 1350 stores me g 
object 1350. The LU createD ataPacka E er function 

singl e session of me targe, application 505. Even *oug ^ ^ 

retumstheabstractclassCAbsDataPackagerl335totheCUsag 

Z it is acmally the derived Cass CExitDataPackager ,340 of me abstract Cass 
c! lolaekager .335 tha, is being returned to the CUsageDataSendManager objec, 1330. 
TcUsageDataSendManager objec, 1330 is no, aware ,ha, i, will be using the 

As shown in Figure 20, me CUsageDataSendManager object 1 30 men p 
CUsageDataasaparameterasi.calls^ep^ 

■ 1 VPS to the CUsageDataSendManager object 1330 to indicate 
signal YES to the cusag ODera tion packages the usage 
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CUs ag eDa«aob j ect 1 3Rd«heCUsageDa,a 0 bjec,1325 I e.ur„san,ap«othe 

1 . „..,L..„„,n J n The map contains usage data about .he current session of 

cumu,a,ive use, the star, time, ana the duration. The CExitDataPackager objec. 1 40 then 
passes this map as a parameter as i, caiis the setSessionrnformation funcnon o 

v + 1-^0 The CExitDataPackager object 1340 calls me 
TOneSessionUsagelnformation object 1350. lhect-xuuai & 

U25 returns a map to the CExuDataPackager object ,340. The map _ag= data 

about the command used in the current session of the target appHcation 505. The 

CExitDataPackager object i340 then passes this map as a parameter as ,, calls .he 
setSessionUsageDatafunctionoftheCOneSessionUsageinformat.onobjectnSO.Wthboft . 

setaessionusiis packaged into 

maps set in the COneSessionUsagelnformafon object 1350, the usage 
an objec.ma.canbepassed.o<heSendingPackage,600. 

The CUsageDataSendManager object 1330 cans its own is DataReadyToSend 
Action and r«ums YES to indicate tha, the usage data is read y to be passed to . e Sending 
^OO.TheCUsageDataSendManage^^ 
fcja of me CExitDataPackager objec, 1340 and the 

returns a CAbsUsageMormation to the CUsageDataSendManager object 1 330. Even thoug 

getPac^gedUsageDatafUn^^ 
absL Cass CAbsUsageinformation .345 to the CUsageDataSendManager obje« 1330. 
^lallv the derived class COneSessionUsageMormation ,350 of the abstract Cass 
clbsuJgein— ^ 

1330 The CUsageDataSendManager object 1330 is no. aware that t. has the 

1330. Thee g ,. nobiectl350 wW ch contains the usage data to be passed to the 

COneSessionUsagelnformation object 1 35u wnici 

Sending Package 1600. The CUsageDataSendManager object 1330 then passes .he 
Sending racK S sendUsageData function of the Sending 

CAbsUsagelnformaUon as a parameter as ,t calls the g 

Package 1600. The Sending Package 1600 rehirns a confirmation s Ig na, YES to info™ 
C^eDataSendManager objec. 1330 tha, the usage data was success* sen. .o -he 
«Z part, Even though the abstract class CAbsUsageinformauon ,345 was passed .o .he 

"liackage,^ 
object 1350 that was passed to it. 
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Figure 21 showSe operation of sending .he usage dam of ,he target application in 
. „ A nn This ooeration occurs when the target application 505 calls the 

stopMonitoring ft.nc.ion of the Monuoring Parage 1200. The operates n, Frg^e 21 are 
continuation of the operations of Figure 20. The sendUsageData function of .he Sendrng 
Package .600, as of step 12, in Figure 20 corresponds to the sendUsageData function of .he 
CScndTriggerIF object 1605, as of step 1, in Figure 21. 

As shown in Figure 21, .he CScndTriggerIF object .605 cails i.s own sefRecrprenK 
action. Within its own setRecipients function, the CSendTriggertf ' ^ ^ 
suing as a parameter as i, calls the setRecipients function of CSendMaulF obtec, 1620. The 
str in represent tire e-nrail address to which the Sending Package ,600 will send tire usage 
da* of ,1 targe. appUcation 505 . This operation sets the e-nrail addresses in CSc— 
objec, 1620 so .ha, i. will know where to send the usage data of tire targe, appUcation 505. 

The CSendTriggerff object 1605 then passes the CAbsUsagelnformation as a 
parameter as it calls the modifyUsageData function of CConvertinputiF object 16,0. The 
CAbsUsagelnformation ccn,ains .he usage data of .he target application 505. The 
CConvertmputlF object ,6,0 returns tire CAbsUsagelnformation to .he CSendTrrggerIF 
object ,605. This operation converts the usage data of tire «arge. appUcation 505 stored m 
cLusage.nforma.ion. Thus, the usage data in tire CAbsUsagelnformation passed rnto tire 
molyUsageData function of CConvertlnputiF objec. .6,0 may differ from .he usage data m 
CAbsUsagelnformation returned by .his taction. For example, the usage data tn 
CAbsUsagemformation passed into tire modifyUsageDa. taction may concur rnformation 

convert tire usage da<a in CAbsUsagelnformation so ,ha. when i. is returned by tire 
modifyUsageDa,a taction, i, contains information abouuhe fluency of use of the 

commands used in the target application 505. 

• o- ,„.:>, the CSendTrisgerlF object 1605 passes tire 
AsshowninFigure21,UTeuaenainBBc 

CAbsUsagetaformation as a parameter as i, calls tire encodeMailBody function of CEncodelF 
objec, 1615. CAbsUsagelnformation con«ains tire usage dataof the targe, appUcation 505. 
2 CEncodCF objec, .6.5 returns a string to the CSendTriggerrF objec, ,605. The strmg 

e-mailed to a desired party. This operation encodes and encrypts .he usage dam m 
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CAbsUsagelnformation into the string. Then the CSendTriggerIF object 1605 passes the 
string as a parameter as it calls the sendDataViaEmail function of CSendMaillF object 1620. 
The string represents the mail body containing the usage data of the target application 505. 
The CSendMaillF object 1620 returns a confirmation signal YES to the CSendTriggerIF 
object 1605 indicating that it was successful in sending the usage data of the target 
application 505. This operation sends usage data of the target application 505 by e-mail to the 
desired party. 

As noted above with reference to Figure 14, in the present invention the Monitoring 
Package 1200 sends the CAbsUsagelnformation as a parameter to a sendUsageData function 
of the Sending Package 1600. That CAbsUsagelnformation can vary significantly. More 
particularly, the information sent from the Monitoring Package 1200 to the Sending Package 
1600 depends on the different trigger information and different information as to the number 
of sessions of the target application 505 to be executed prior to sending information from the 
Sending Package 1600. As a result, there are variations in the size of the data and the 
structure of the data to be sent by the Sending Package 1600. As an example, in one feature 
of the present invention, the monitored data generated from the Monitoring Package 1200 can 
be sent by the Sending Package 1600 after each usage of a monitored target application 505. 
As another option, the monitored data can be sent by the Sending Package 1600 after a 
certain number of sessions (e.g., five sessions) of the monitored target application 505 have 
been executed. In those two different instances, the amount of data and the structure of the 
data to be sent by the Sending Package 1600 will vary significantly. 

In one embodiment of the present invention, different algorithms are provided within 
the Sending Package 1600 for each different type of data. However, that embodiment results 
in the Sending Package 1600 becoming very complicated in requiring algorithms to address 
all the different forms of the data provided from the Monitoring Package 1200. A further 
drawback with the Sending Package 1600 addressing the different forms of the data is that the 
algorithms in the Sending Package 1600 would have to be updated every time a change was 
made in the monitoring operation of the Monitoring Package 1200. 

In an alternate embodiment, the Sending Package 1600 is designed to be independent 
of the differences in data output from the Monitoring Package 1200. That is, the present 
invention may further utilize an approach which avoids requiring complicated algorithms 
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which would require significant updating in the Sending Package 16UU to address all the 
different data sizes and structures output from the Monitoring Package 1200. More 
particularly, the present invention may further utilize a system which defines an abstract class 
to interface between the Monitoring Package 1200 and the Sending Package 1600. This 
operation in the present invention allows the Sending Package 1600 to be isolated from the 
details of the CAbsUsagelnformation sent from the Monitoring Package 1200. That is, with 
this approach, the Sending Package 1 600 treats all of the CAbsUsagelnformation sent from 
the Monitoring Package 1 200 the same and does not have to determine how the data is 
represented and how much data is included in the CAbsUsagelnformation (e.g., how many 
sessions of data are included therein, the data structure, etc.) Even more particularly, as 
shown in Figure 14, the CAbsUsagelnformation is passed from the Monitoring Package 1200 
to the Sending Package 1600 as an abstract class. 

Specific details of utilizing an abstract class for the CAbsUsagelnformation passed 
from the Monitoring Package 1200 to the Sending Package 1600 is disclosed in further detail 
in Applicants' copending U.S. application with attorney docket no. 5244-0099-2, the entire 
contents of which are hereby incorporated herein by reference. 

Further, an abstract class can be utilized to package the CAbsUsagelnformation and to 
encode the CAbsUsagelnformation prior to the CAbsUsagelnformation being passed from 
the Monitoring Package 1200 to the Sending Package 1600. Also, an abstract class can be 
utilized to validate and encode the CAbsUsagelnformation prior to the Sending Package 1 600 
sending the usage data. More specific details of encoding and packaging the 
CAbsUsagelnformation passed from the Monitoring Package 1200 to the Sending Package 
1600 and the encoding and validating of the CAbsUsagelnformation within the Sending 
Package are disclosed in Applicants' copending U.S. patent applications with attorney docket 
nos. 5244-0104-2X, 5244-0105-2X, and 5244-0106-2X. The entire contents of each of those 
applications is hereby incorporated herein by reference. 

As noted above, in the present invention, usage of a target application 505 is 
monitored and logged in the Monitoring Package 1200 and is then sent by "store-and- 
forward" or direct communication by the Sending Package 1600. 



32 



A further feature of the present invention is an efficient manner of logging or storing 
the usage data by the Monitoring Package 1200 of a current session of the target application 
505. 

Even more particularly, Figure 22 shows a map structure 1 800 which can be utilized 
5 to store usage data of plural target applications 505, and particularly in a situation in which a 
target application 505 is a target software application. In that instance, the maps 1800 shown 
in Figure 22 can store data as to how a user is utilizing either of the software applications as 
the target application 505. Utilization of the maps 1 800 is performed in the CUsageData 
object 1325 shown in Figures 13, 16, 17, 18, 19 and 20 above. That is, the CUsageData 
10 object 1325 can include functions of storing data in and retrieving data from a map 1800 such 
as shown in Figure 22. 

The maps 1800 shown in Figure 22 store information about the type of usage data, i.e. 
a key, in a key portion 1810, and its corresponding value in a data value portion 1820. The 
^ type of usage data, i.e. the key, is mapped to its corresponding value to allow easy storage 

15 and access of the usage data, which in the example noted above is data indicating a user's 
O usage of a target software application. The maps 1800 store specific information about the 

^ usage of each of the target applications but also allow new usage data to be logged thereto. 

^ As a result, a benefit of utilizing such a map structure in the present invention is that the map 

M= 1800 allows a Monitoring Package 1200 to be extended to log new types of usage data about 

20 the target application 505. 
14 Typically, the usage data is stored in the maps 1800 as strings. The usage data of a 

B target application 505 may not be collected as strings, but can be converted into strings before 

being stored in the map 1800. By storing all usage data in the maps 1800 as strings, the 
storage and access of the usage data from the maps 1800 can be simplified. 
25 The maps 1800 of Figure 22 may be implemented utilizing a template, map, etc. of 

the standard template library (STL), the map class CMap of the Microsoft Foundation Class 
(MFC) library, or a dictionary in the Perl programing language, as examples. The maps 1800 
allow one value to be associated, or mapped, to another value, and includes the key portion 
1810 and the data value portion 1820 such that each key is associated with a value. Several 
30 functions can be used to store and access the keys and values in the map 1 800. The keys and 
values may be of any type, including integers or strings, although as noted above it may be 
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preferable to store all tlJfce data in the keys and values as strings^implify storage in 
and accessing of the usage data from the map 1800. In that instance, the map 1800 is used to 

map a string to a string. 

The maps 1 800 are used in the Monitoring Package 1 200 to log usage data from 
plural sessions of one or more target applications 505. The usage data may be logged into the 
map 1 800 and may include several data fields directed to a user's usage of a target application 
505, e.g., a target software application, including a user ID, an application ID, the cumulative 
number of sessions of the target application, a start time of the target application, a duration 
of the target application, etc. 

In one embodiment in which multiple instances of a target application cannot be run 
simultaneously, these data fields can be stored into the system registry as a kind of global 
variable. However, if multiple instances of an application can be run simultaneously, the data 
needs to be stored such that each application can read and write the data without interfering 
with the operation of the other applications. Such data independence also guarantees that one 
application finishing does not overwrite the usage and frequency information stored by 
another application that is still running or that previously finished. 

Examples of the maps 1800 shown in Figure 22 are shown in Figure 23 as maps 1900 
with specific data stored therein for each of two target applications. The maps 1900 are 
examples of maps used to log usage data from two sessions, which, in this example, are target 
software applications. The key portions 1910 of the maps 1900 represent strings, and the 
data value portions 1920 of the maps 1900 also represent strings. Each key is a string 
representing a type of usage data of the target software application. Each key describes what 
its corresponding data value represents. In the maps 1900 shown in Figure 23, the key 
"UserlD" represents the name of the user utilizing the target software application and the key 
"StartTime" represents the time that the target software application was started. Each data 
value in the maps 1900 is a string representing the actual usage data. The other examples of 
the keys shown in the maps 1900 in Figure 23 are the keys "ApplicationlD" indicating the 
name of the target software application for which usage is being monitored, and 
••CummulativeUse" indicating the number of times that the specific target software 
application has been utilized. 
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In the specific example of maps 1900 shown in Figure 23, the value mapped to the 
key "UserlD" for the target application indicates the name of the user of the target software 

.. . ^rj-i it +V»o +im<a that 

application, and the data value corresponding to tne Key ^-nu. — - - 

the user started utilizing the target software application. Further, the value "MB" 
corresponding to the key " Application^" indicates that the usage of the target application 
with the software name MB is being monitored. Similarly, the data value 45 corresponding 
to the key "CummulativeUse" indicates that the target software application MB has been used 
45 times. For the second target application, different values are stored for each of the keys. 

The maps 1900 in Figure 23 only show four types of usage data, but clearly the maps 
1900 can be used to contain additional data with respect to monitoring usage of the target 
software application. Further, by expanding the data logged in the map 1900, the Monitoring 
Package 1200 can be extended to log new usage data directed to the target software 
application. 

Figure 24 shows a second map structure which can be utilized by the CUsageData 
object 1325 to store usage data of atarget application 505, again particularly when those 
target applications are software applications. In the maps 2000 shown in Figure 24, the keys 
in the key portion 2010 are strings, and the data values in the data value portion 2020 are 
vectors. The term vertorjn*^^ Jhe^ors^ 
K ^^ted using the template, vector, of the stan dardjg^^ as one 

^^n^aps 2000 shown in Figure 24, each of vectors 2030-2060 are arrays of 
strings. Thus, the maps 2000 are used to map keys (in string form) to vector data values m 
which the vectors contain strings. 

Such maps 2000 can be utilized in a Monitoring Package 1200 to log usage data 
directed to the selecting of commands of each target software application. In the embodiment 
shown in Figure 24, four entries, i.e., four keys and their corresponding four values, are 
utilized in the maps 2000 to log usage data about the target software applications. One vector 
is utilized for the names of the commands used, and the second vector is utilized for the 
information associated with the commands. The keys for those two vectors are stnngs 
indicating the type of information contained in the vector. 

Figure 25 shows a specific example of maps 2100 corresponding to the maps 2000 of 
Figure 24 but with specific examples of keys and data values inserted therein. The example 
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,a ilUgaindirectedtoanexampleinwhic^oso^areW 

shown in Figures 24 anTO vs agam responding to those 

,. . <ns monitor a user's usage of the user raw 
target app"va»""" 

aW "' s 2100 o( Figure 25, the key is a string representing the type of information 

' n,hemaPS L vec<ot The data value is the vectors 2130-2160 contatnmg 

contained in the correspondmg vectors. 

.rings that represent information about me commands used mthetarg 

applications. „ one characteristic monitored in both applications 

!» the example shown ,n F.gure 25, one charac ^ ^ 

t- i„„» This is tracked using the first Key ana cor, f 
is ,he XommandNameTtrmng. Thrs ^ m 

oata 2130 containing the names of the comman s fo wtach J „ 

eK . As aiso shown in Figure 25, in the maps 210 , the key ^ ^ ^ 

corresponding vector data 2140 contains a time e laps ^ 

213 0and2140 prov.de alog of attrrung corresp onding to tire key 

specific command was utilized by a use, Thatvs t SQ ^ 

command name "PenCho.ce asso^ ^ ^ ^ ^ ^ forth 

associated with 65, the ^ 25 the vecto r data2130 and 2140 indicate the 

Thus, in the maps 2100 shown ,n Mg ^ comman ds are used. The 

apphcatron MB, urevecto appfation , «„ com mand 

"Diagnosis." b t the CO mmand usage 

The vec,o,s2,30-2,60 may contain large amounts f d^ahou 
ofthetarge, software applications. By utilizing such a vector structure any n 
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can be easily added to the Sectors 2130-2160. Thus, the Moni,orinft*age 1200 may log 
new commands of me target software application without any modifications. Moreover, 

. - _ - .1 --c /A^tVtf* rnmmanrts. i.e.. 

entries may be added to the map 2 iuu aooui omci uuu.. — 

additional vectors may be added. 

In the example shown in Figure 25, keys "CommandNameFreq" and "Frequency are 
also shown and the corresponding vectors 2150 and 2160 store information about the number 
of times certain commands are used in the target software applications. More particularly, as 
noted above the firs, two keys in the maps 1200 are used to log usage data about the use of 
commands in the target software applications. The firs, two keys "CommandNameTimmg" 
and "Timing" log usage data of the number of tenths of a second from the starting of a target 
software application until a certain command is seated. In me map 2.00 shown in Figure 
25 Ihe keys "CommandNameFreq" and "Frequency" indicate the number of times a certatn 
command is selected. The data values, i.e., the vectors 2150 and 2160, corresponding ,0 the 
respective keys "CommandNameFreq" and "Frequency" for the application "MB," indicate m 
me example of Figure 25 ma, me command "EditCut" was used 10 times, the command 
■EditPaste" was used 10 times, and the command "EraserForma." was used 4 times. 

In the figures noted above, strings are used for me keys and the data values m the 
maps 1 800 and 1900 in Figures 22 and 23, respectively. In Figures 24 and 25, stimgs are 
used for tire keys of tire maps 2000, 2!00 and for the values within the vectors. The stnngs 
may be arrays of characters and may be implemented using the stnng temp.ate of the standard 
template library (STL) or the string class, CString, of the Microsoft Foundation Class (MFC) 

library. t 

Further, the usage data collected is no. used for calculation purposes bu, for reporting 

purposes. Therefore, all the usage data collected, whether i, is strings, integers, or other types 

of da,a, may be stored in the maps as strings. If the usage data collected includes dati, ,ypes 

otter man strings, then the data type may be converted ,0 strings before being placed into the 

maps or vectors noted above. Keeping all the values of strings allows for simple encodmg 

and encrypting of the usage data before i, is sen, by me Sending Package 1600 by e-marl. 

Wi,h the above-discussed operations, the present invention provides a control 

operation for monitoring a user, usage of user interfaces which are part of plural different 

,arge, applications or plural instances of ft. same application. Further, such an operation of 
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v»p storlund to be transmitted, at 

mepr.e '^^T^S™*"** 

. . , . *wc hv a "store-and-forward protocol leg, 

appropriate* — J- . a convenien , SOUICe ot SU ch a fission ««■. — - 

rr. — — — ^rrrsr:- 

costs of the transmission. Further, Mltoma ticaUy sent to a further 

mail. Such an operation is possioi 

efficiency of an, a»a,y,n g " - utilizes computers having 

separate housings than the devic ^ computer for 

*^>^»^ZZ2~„»~-L Suchan 
performing the desired processus thus .he ^ ^ 

arrangement may aiso permit impiementatton of th m, ^ ^ ^ 

;fHp^ired the present invention may oe imp 
the device. However, if desired, P ^ . g being momtored 

application by reference. This patent app ^nations of various features 

md functions of the individual — ^ o, the reiated apphcations or paten. 
5 m e related appiicatton. Thus f ^ ^ ^ „ disclosed 

may be readily applied a concept dtsdosed ta 
in one or more of me other applications may b ^ » *- ^ ^ 

ot her(s) ofthe applications. Further, an e-ma, mess e ^ ^ 

• the other direction being performed using a qui 

communication in the other air disc iosed herein, or a 

u ~n«* of the other communication modes ai> 
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This invention may be convenient* implemented using a Ational genera, 
_..„„.. ^ comouter or microprocessor programmed according to the teachmgs o, the 
p^spliftcation, as win he apparent to those stilled in the computer art. Appropnate 
ftware coding can readtly he prepared by skilled programmers based on the teachrngs of the 

iso be impiemented by the preparation of application specific integrated crcutts b 
interconnecting an appropriate network of conventional component c,rcu,ts, as wtl, be readtiy 
apparent to those skilled in the art. 

The present invention includes a computer program product whtch ts a storage 

medium including instructions which can he used to program a computer to perform a 

L inciuding fioppy disks, optical discs, CD-ROMS, and magneto -opttca, dr^ROM . 
RAMs, EPROMS, EEPROMS, magnetic or optical cards, or any type of medta stutahle 

rlputer to interact with a human use, Suc\ software may include, hut „ no, hunted to, 
tolerating systems, deve.opmen, lis, and user applicaUons. Such computer 

monitoring a user, interactions with a user interface. The computer code devtces of the 
^ to scripts, interpreters, dynamtc link libraries, ,ava Casses, and compiete execute 



programs. 



Obviously, numerous addition, modifications and variations °" 
are possible in Ugh. of the above teachings. It is therefore to be understood that wtthtn the 

specifically described herein. 
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